Molecular Contrastive Learning with Chemical Element Knowledge Graph
نویسندگان
چکیده
Molecular representation learning contributes to multiple downstream tasks such as molecular property prediction and drug design. To properly represent molecules, graph contrastive is a promising paradigm it utilizes self-supervision signals has no requirements for human annotations. However, prior works fail incorporate fundamental domain knowledge into semantics thus ignore the correlations between atoms that have common attributes but are not directly connected by bonds. address these issues, we construct Chemical Element Knowledge Graph (KG) summarize microscopic associations elements propose novel Knowledge-enhanced Contrastive Learning (KCL) framework learning. KCL consists of three modules. The first module, knowledge-guided augmentation, augments original based on KG. second knowledge-aware representation, extracts representations with encoder Knowledge-aware Message Passing Neural Network (KMPNN) encode complex information in augmented graph. final module objective, where maximize agreement two views graphs. Extensive experiments demonstrated obtained superior performances against state-of-the-art baselines eight datasets. Visualization interpret what learned from
منابع مشابه
Personal Knowledge/Learning Graph
Educational data mining and learning analytics have to date largely focused on specific research questions that provide insight into granular interactions. These insights have been abstracted to include the development of predictive models, intelligent tutors, and adaptive learning. While there are several domains where holistic or systems models have provided additional explanatory power, work...
متن کاملContrastive Knowledge Surveyed
Suppose that Ann says, “Keith knows that the bank will be open tomorrow.” Her audience may well agree. Her knowledge ascription may seem true. But now suppose that Ben—in a different context—also says “Keith knows that the bank will be open tomorrow.” His audience may well disagree. His knowledge ascription may seem false. Indeed, a number of philosophers have claimed that people’s intuitions a...
متن کاملConvolutional Neural Knowledge Graph Learning
Previous models for learning entity and relationship embeddings of knowledge graphs such as TransE, TransH, and TransR aim to explore new links based on learned representations. However, these models interpret relationships as simple translations on entity embeddings. In this paper, we try to learn more complex connections between entities and relationships. In particular, we use a Convolutiona...
متن کاملOn Contrastive Divergence Learning
Maximum-likelihood (ML) learning of Markov random fields is challenging because it requires estimates of averages that have an exponential number of terms. Markov chain Monte Carlo methods typically take a long time to converge on unbiased estimates, but Hinton (2002) showed that if the Markov chain is only run for a few steps, the learning can still work well and it approximately minimizes a d...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence
سال: 2022
ISSN: ['2159-5399', '2374-3468']
DOI: https://doi.org/10.1609/aaai.v36i4.20313